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bookmarking and quick jumping to links within other sites. Subscribers, such as customers and vendors, can quickly and efficiently 
transact business (20,26,40) through the system. 
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SYSTEM AND METHOD FOR VOICE -ACTIVATED WEB CONTENT NAVIGATION 

BACKGROUND OF THE INVENTION 
Technical Field 

The present invention pertains to voice access and interaction with web- 
5 based services and content, and, more particularly, to a system and method, including 
software and software architecture, that enables verbal interaction with computers, 
mobile devices, voice sites, voice content, and data and web-based services, all via a 
local and worldwide computer network, such as the Internet. 

Description of the Related Art 
10 Telephonic communication is convenient, rapid, and provides 

accessibility to many private and commercial services. Mobile and cellular telephones 

provide increased access to telephonic communication and, hence have resulted in 

increased use and reliance on telephonic communications. 

An area where voice communication has been underutilized is in 
15 accessing remote devices, such as computers, electronic messaging, and information 

and service providers doing business over public computer networks, such as the 

Internet. 

BRIEF SUMMARY OF THE INVENTION 

The present invention provides a system and method for enabling verbal 

20 access to and interaction with computers, mobile devices, and voice and data 
communication services via a computer network, such as the Internet. In accordance 
with a method of the present invention, users access the system via a telephonic link, 
such as by dialing a telephone number to access a voice portal. Using verbal 
commands, such as keywords, the user may access voice messages, electronic mail 

25 (e-mail), and computer networks, such as the Internet. Access to web sites via existing 



WO 02/11120 



PCT/US01/24486 



2 

bookmarks or keywords, e-mail addresses for messaging, as well as utility applications, 
such as reconfiguring a user's personal parameters in the system is also provided. 

In accordance with a system of the present invention, users can access 
web-based content and services with spoken natural language commands. 
5 In accordance with one embodiment of the present invention, a method 

for navigating retrieved web-based content is provided that includes translating the 
web-based content into a natural language voice content for voice applications; dividing 
the natural language voice content into navigational objects; and associating each 
navigational object with pre-built navigation options. The method can further include 

10 selecting any one of the navigation options by voice to perform the navigation option 
associated with the navigational object. Moreover, the method can further include 
sequentially playing the voice content of the navigational object resulting from the 
selected navigation option and, at the choice of the user, playing the voice content 
associated with the navigational object next in sequence or selecting another 

1 5 navigational obj ect . 

In accordance with another aspect of the foregoing method, the 
navigation options can include at least one application option such as e-mail, facsimile, 
printing, and telephone notification. 

In accordance with another embodiment of the invention, a method for 

20 enabling a caller to transfer to a third-party telephone number after hearing voice 
advertisements is provided. The method includes providing the voice advertisement for 
an advertiser; providing a keyword associated with an action of connecting to the 
advertiser's voice site; providing a keyword to bookmark a link to the advertiser's voice 
site; carrying out an action associated with the keyword spoken by the user to connect 

25 to the advertiser's voice site or to bookmark a link to the advertiser's voice site; and 
returning to the advertisement. 

In accordance with another embodiment of the invention, a method for 
jumping to a link inside a voice portal is provided. The method includes receiving a 
voice command containing at least two natural language phrases; dividing the at least 
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two natural language phrases into objects that represent an action and an item; 
translating the objects into corresponding text objects; concatenating the text objects 
into a hyperlink to a voice site; and executing the hyperlink to the identified link in the 
voice site. 

5 In accordance with another aspect of the foregoing method, the voice 

command contains at least three natural language phrases that are divided into three 
objects, an action object, an item object, and a supplier object. 

In accordance with another embodiment of the invention, a method of 
interacting with a voice home page via telephone for providing voice portal access via 

10 subscriber voice-mail numbers is provided. The method includes storing user and 
advertiser information in a voice-content memory; receiving a telephone call from a 
user; providing the user with options to leave a message or to access voice-based links 
to a voice website; and responding to the selection by executing the link associated with 
a command spoken by the user. Ideally, the method includes capturing the DID number 

15 to retrieve user information and to provide the same information to the recipient of the 
call. 

In accordance with another aspect of the foregoing method, a system is 
provided that includes a web-based server with a voice browser configured to provide 
interaction with a voice homepage and to jump to a link in accordance with the 
20 foregoing methods. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS 

The foregoing features and advantages of the present invention will be 
more readily appreciated as the same become better understood from the following 
detailed description when taken in conjunction with the accompanying drawings, 
25 wherein: 

Figure 1 is a diagram of the system architecture formed in accordance 
with one embodiment of the present invention; 
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Figure 2 is a diagram of a voice portal architecture formed in accordance 
with the present invention; 

Figure 3 is a diagram illustrating the telephonic connection between a 
caller and a hosting company; 
5 Figure 4 is a diagram illustrating a representative example of user login 

to a system formed in accordance with the present invention; 

Figures 5A-5F are diagrams illustrating the Drivelt! application for 
obtaining driving directions; 

Figure 6 is a diagram illustrating user access to travel-related sites; 
10 Figure 7 is a diagram illustrating user access to electronic mail and 

messaging; 

Figure 8 is a diagram illustrating user access to electronic purchasing; 

Figures 9 is a diagram illustrating the Advertiselt! application; 

Figures 1 OA- 10C are diagrams illustrating the Purchaselt! application; 

15 and 

Figures 1 1 A-l 1L are diagrams illustrating the My.Speaklink application. 



DETAILED DESCRIPTION OF THE INVENTION 

Referring initially to Figures 1 and 2, the system 10 of the present 
invention includes in one embodiment a voice portal architecture 12 that provides 

20 interconnectivity with web-based providers and others via a voice portal application 14, 
a web portal application 16, and with specialized applications that include the 
Advertiselt! application 18, the Purchaselt! application 20, and the Drivelt! application 
22. The My.Speaklink application 24 and the Traffic Speak application 26 provide user 
customization and subscriber information sharing. It is to be understood that for 

25 purposes of this description, the terms "caller," "user," and "subscriber" are used 
interchangeably unless otherwise indicated or as understood from the context. 

As shown in Figure 2, a user can connect to voice site menus 28 via call 
management software 30 and to various applications, including, as one example, the 
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Drivelt! application 22, as well as connecting to website menus 32 via the Web parser 
application 34 and the Language application 36. Information and data, such as 
subscriber and caller information, are obtained through the Register/Login application 
40, the Purchaselt! application 20, and the Traffic Speak application 26 are stored in the 
5 database 44. 

An overview of a telephonic connection between a user telephone 46 and 
a host site 56 is shown in Figure 3. The telephone 46, which can be a land line or a 
wireless device, is initially connected to a local area network LAN 48 through a 
telephony server/voice browser 50. Using as an example a Tl line 42 from the LAN 

10 48, connection is made to the Internet 52 and thence through a hosting company 
backbone 54 to a hosting company's website 56. This connection is essentially 
transparent to the caller. 

Once connected to the host site 56, a user logs in at the site. One 
example of login is shown in Figure 4. The user will hear an initial welcome ad 58, 

15 which can play for approximately 15 seconds. If the user desires more information, the 
user speaks a keyword, which may be a word as indicated in the welcome ad 58, at 
which point the user is transferred to a site that provides more information about the 
welcome ad 58. Such site can be the host site for the vendor of the ad where the user 
can obtain more information or order services or product. The user then speaks another 

20 keyword, such as "Return" or "Back" to return to the previous point in the login 
process, which in this case would be the welcome ad 58. 

After the welcome ad 58 concludes, the user is then connected to the 
front page or main menu 60 of the host site 56. At this point a submenu ad 62 is played 
when the user selects a submenu 64 from the front page 60. 

25 While at the front page or main menu 60, the user may also hear a 

targeted "Keyword Ad" 66. If the user desires, additional information is obtained by 
speaking the keyword, at which time the user is redirected to the keyword's voice site 
68. Return to the main menu 60 is effectuated by speaking the appropriate command, 
e.g., "Return" or Back." 
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The Web parser application 34 is configured to gather information from 
the web site and transform it into voice XML. The voice XML can then be played to 
the user by telephone. The language used, i.e., English, French, German, etc., is based 
on a user's preference. The language selection can be made by the user dynamically or 
5 at the time of login. 

At the time of login, the register/login application 40 identifies a caller 
using their Caller ID number, which is stored in the database 44. At the initial step the 
user registers by entering an address and profile of him/herself. A "voice print" may be 
recorded of their voice for later voice verification as part of the security procedure. 

10 After the user registers, the user can then send feedback to the service. 

The Purchaselt! application 20 is configured to allow a user to request a 
product from a vendor's voice site. The user provides necessary information in the 
fields requested by the voice site in order to complete the purchase. The voice site is 
required by the system 10 to submit an authorization code in order to complete the 

15 transaction. This is shown graphically in Figure 10B where the host site 56, identified 
as "Speaklink data center" utilizes the stored subscriber profile 70, tracked subscriber 
purchases 72, and stored subscriber authorizations 74 to provide quick, secure access 
and seamless transactions. 

The Purchaselt! architecture is shown more clearly in Figure 10A where 

20 the Purchaselt! application 20 resides at the host site data center 56, which includes the 
stored subscriber profile 70, track subscriber purchases 72, and stored subscriber 
authorization 74. A partner voice site 76 promotes the product 78 that the subscriber 
desires to purchase. Authorization for product purchase occurs when the partner voice 
site 76 sends the partner request code 80 that requests authorization from the host site 

25 data center 56. 

As shown in Figure 10C, each partner voice site 76 that desires to use 
the Purchaselt! application 20 service will need to have an authorization code. The 
code authorizes the transaction. The host site 56 will send the partner voice site 76 the 
purchasing and profiling information required to make the purchase from the stored 
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subscriber authorizations 74. The subscriber may verify the information using speaker 
verification. 

Referring next to Figures 5A-5F, shown therein is a graphic 
representation of the voice portal architecture for the Drivelt! application 22. The user 
5 initially accesses the service by speaking a key word, such as "drive it." The Drivelt! 
application 22 begins the process by asking the user for a starting block number 82. 
The user then states the numeric block number 82 that they are either located at or are 
starting from. The application 22 then asks the user for the geographical direction or 
the front direction 84 of the street if there is a direction preceding the street name. The 
10 user responds by speaking direction, e.g., North, South, East, West, Southeast, 
Southwest, Northwest, or Northeast. The user is then asked to verify whether the street 
has a numerical or alphabetical street name 86. 

In identifying the street name 86, if the user says "alphabetical," then the 
application 22 asks for the spelling of the street name or for the user to specify if the 
15 street name is already on file. Street names are stored and retrieved from the database 
44. 

Next, the user is asked for the street suffix 88, to which the user responds 
by stating the appropriate suffix, such as street, court, road, avenue, etc. Finally, the 
user is asked to provide the geographical direction following the street suffix, if there is 

20 one, to which the user responds appropriately, e.g., North, South, East, West, Southeast, 
Southwest, Northwest, or Northeast. Once this back direction 90 is received, the 
address is then compiled into a complete address by concatenating the block number 82, 
the front direction 84, street name 86, street suffix 88, and the back direction 90. The 
end result at this point is a complete USA street address 92, such as 123 North Main 

25 Street. 

Referring next to Figure 5B, after the street address 92 is collected 
through the user's responses, the user is then asked for the spelling of the city they are 
starting from or for the user to say the city name 94 if it is already stored in the database 
44. If a new name is spoken, it is stored in the database 44 for future reference. Next, 
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the user is asked to identify the state 96 they are starting from, and after the response is 
received from the user, the process is complete for obtaining the starting from 
information. The application 22 then repeats this process to obtain the destination 
location. The starting and destination addresses are then provided to a submit engine 
5 98, which retrieves returned directions from a map provider, such as MapQuest.com via 
a convert engine 100 and converge engine 102. 

As shown more clearly in Figure 5C, the full address 104 is submitted to 
the map provider via a licensed MapQuest CGI-BIN application. The primary focus of 
the CGI-BIN application that MapQuest sells via their website is to request the driving 

10 directions from the MapQuest.com webservers. The CGI-BIN application 106 returns 
turn-by-turn driving directions back in raw code 108 form, such as "Turn RT on Main 
ST N" as shown in Figure 10. When the converge engine 102 receives the raw code 
108, it is compared against a list of converters such as to make "RT" become "Right," 
and so forth. The converge engine 102 contains a master list that does the verbal 

15 translation of the converting on-the-fly of the raw code 108, making it plain English for 
the text-to-speech engine 110 that includes a verbal translation parser 112 that returns 
the plain English code as shown in Figure 5D. 

The returned plain English code 114 from the verbal translation parser 
112 is then placed in an HTML page Tripplus.htm 116. The user then retrieves the 

20 turn-by-turn directions via a sequencer 118 that enables the user to say "play," 
"rewind," "forward," "fast forward," "skip," or "pause" to control the playback of the 
directions. In order for this to occur, the converge engine 102 is configured to make 
necessary changes on each turn-by-turn direction to sequence the animation of the 
directions. The converge engine 102 is thus configured to primarily put in the 

25 Tripplus.htm 116 the numbers that correlate to the turns, such as "turn 1," "turn 2," 
"turn 3," etc. Also, when the user says "rewind," the code found in Tripplus.htm 116 
will control the playback to go to "turn 1," "turn 2," "turn 3," etc. The CGI-BIN 
application 106 returns the raw code 108 to the Tripplus.htm 116 HTML page, and it is 
the function of all three engines - the submit engine 98, the convert engine 100, and the 
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converge engine 102 - to function together to bring the translation into plain English 
and provide the VCR-like capabilities when piped through a text-to-speech engine 110. 

After processing the directions, the user can direct the output via the 
Drivelt! engine 120 to external devices such as a phone 122, e-mail 124, fax 126 5 or a 
5 pager 128. Once the user specifies the device, such as by saying "e-mail," the user is 
then taken to another page that asks for the name of the user, the username of the user, 
and the domain name of the user. The directions are then sent to the specified device, 
such as e-mail 124 via the e-mail address just collected. 

After sending the e-mail, the user can return to where they left off in the 

10 hearing of the directions by speaking a keyword. Should the user desire to send the 
output to another device, such as a facsimile machine, the user will say "fax," and they 
are taken to another page that asks for the fax number and the username. The 
application 22 then sends the facsimile to the specified number using an outside 
facsimile-over-internet vendor. If the user says, "pager," the user is then sent to another 

15 page to provide the pager number, PIN, and carrier, and then the application 22 sends 
an e-mail to the pager provider or dials the pager number as necessary. 

The system 10 provides a number of functional features that enable users 
to access virtually website by voice and hear content or transact business. Figures 6 
through 8 are graphical representations of three examples, specifically travel, mail, and 

20 shopping, respectively. As shown in Figure 6, users are able to plan travel and make 
travel arrangements for flights, buses, trains, ferries, hotels, vacation, car rental, and 
obtain directions from the websites of the providers, as indicated. Similarly, as shown 
in Figure 7, users can enter content information by voice to read and reply to e-mail 
POP accounts to read and reply to voicemail accounts, and, for example, to send a voice 

25 greeting via telephone, e-mail, or voicemail. Shopping can be accomplished, as shown 
in Figure 8, for a variety of goods by accessing the websites of the appropriate vendors. 

Set forth below in pseudocode format is the call flow for the voice portal 
system of the present invention. Here, the term "Speaklink" refers to the host site 
provider. The call flow is a representative example of a user's movement through the 
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system 10 by voice. Voice commands are shown within quotes. The system 10 also 
provides global keywords or variables that, during any prompt, a subscriber or user can 
say to get additional information, such as "help," "menu," and "options," as well as 
those described in more detail below under heading number 4. 



5 Call Flow for Speaklink Voice Portal 

1 . [Speaklink Audio Logo] Welcome to Speaklink, the loudest revolution on the 
planet. 

2. [Welcome Advertisement Voice Ad] 

10 3. Say a keyword, or say quick jump to begin. If you would like to hear the front 
page say menu, 
a. Keyword 

i. "Voice Browser" 

1 . Please spell the voice site's URL after the tone. 
1 5 [Speaklink Audio Logo] 

ii. "Mail" 

1 . Would you like to check your e-mail, voice mail, or send 
a Speaklink greeting? 

a. {If E-mail} 

20 i. Would you like to check your Speaklink e- 

mail, or your other e-mail accounts? 

1 . {If Speaklink E-mail} |KWD: "My e-mail" 

a. [POP email application] 

2. {If Other Accounts} 

25 a. [POP email external 

application] 

b. {IfVoice-mail}|KWD: "My Voice mail" 

i. Would you like to check your Speaklink 
voice mail or your other voice mail 
30 accounts? 

1 . {If Speaklink Voice mail} 

a. [Voice Mail Program] 

2. {If Other Accounts} 

a. [V oice Mail Dialer] 

35 c. {If My Speaklink{If Greetings}} | KWD: 

"Greetings" 

i. [Speaklink Greetings Program] 

iii. "News" 

1 . [Menu Voice Ad: Did you know if you sign up for My 
40 Speaklink you can filter news only you want to hear, 

keyword, "My News".] 
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2. {If Basic} Would you like to hear world, national, or 
local news? 

a. {If World news} 

i. [World news] 
5 b. {If National news} 

i. [National news] 
c. {If Local news} 

i. [Local news] 

3. {If My Speaklink} | KWD: "My news" 

10 a. {Would you like to hear your top 5 headlines from 

your news box, or review all new stories? 

i. {If Top 5} 

1. [Top 5] 

ii. {If review all new stories} 

15 1 . Say the category you wish to hear or for a listing say help 

a. [Categories] 

iv. "Weather" 

1 . [Menu Voice Ad: Did you know if you sign up for My 
Speaklink you can filter weather only you want to hear, 

20 keyword, "My Weather' 5 .] 

2. {If Basic} Would you like to hear world, national, or 
local weather? 

a. {If World weather} 

i. [World Weather] 
25 b. {If National weather} 

i. [National weather] 
c. {If Local weather} 

i. [Local weather] 

3. {If My Speaklink} | KWD: "My weather" 
30 a. [Current conditions] 

b. [5 day forecast] 

c. [2 Conditions in city of choice] 

v. "Sports" 

1 . [Menu Voice Ad: Did you know if you sign up for My 
35 Speaklink you can filter sports news and scores only you 

want to hear, keyword, "My Sports".] 

2. {If Basic} Would you like to hear sports scores or sports 
news? 

a. {If Scores} 

40 i. Say the team or league? 

a. [Scores] 

b. {IfNews} 

i. Say the team or league? 

a. [News] 

45 3. {If My Speaklink} | KWD: "My Sports" 

a. [Team scores] 
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b. [Team news] 

vi. "Stocks" 

1 . [Menu Voice Ad: Did you know if you sign up for My 
Speaklink you can filter stock news and quotes only you 

5 want to hear, keyword, "My Sports".] 

2. {If Basic} 

a. Would you like to hear a stock quote or stock 
news? 

i. {If quote} 

10 1 . Say the company name or spell symbol 

a. [Stock application] 

ii. {If news} 

1 . Say the company name or spell the symbol 

a. [Stock news application] 
15 3. {If My Speaklink} | KWD: "MY Sports" 

a. Would you like to hear your stock wrap up or 
local stock information? 

b. {If stock wrap up} 

i. [Stock wrap up] 
20 c. {If local} 

i. [Local info] 

vii. "Health" 

1 . [Menu Voice Ad: Did you know if you sign up for My 
Speaklink you can filter stock news and quotes only you 

25 want to hear, keyword, "My Health".] 

2. {If Basic} 

a. Say the heath condition you are interested in or 
say help to hear the current health topics, 
i. [Health Application] 
30 3. {If My Speaklink} | KWD: "My health" 

a. [Current related health news] 

viii. "Shopping" 

1 . [Menu Voice Ad: Did you know if you sign up for My 
Speaklink you can get specials deals and promotions 

35 delivered to your message box?] 

2. Say a category you would like to browse or say help to 
hear your options. 

a. [Shopping application] 
ix. "Traveling" 

40 1 . [Menu Voice Ad: Did you know if you sign up for My 

Speaklink you can automate your home while you 
travel?] 

2. Say a category such as driving directions or say help to 
hear your options. 

45 a. {If Drive it!/Directions} | KWD: "Drive 

it! /Driving directions" 
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i. [Drive it! application] 

b. {If Flights/airlines} KWD: "Flights/Airlines" 

i. [Flights application] 

c. {If Cars} | KWD: "Cars" 
5 i. [Cars application] 

d. {If Bus} j KWD: "Bus" 

i. [Bus application] 

e. {If Trains} | KWD: "Trains" 

i. [Train application] 
1 0 f. {If Ferries} | KWD: "Ferries" 

i. [Ferries application] 

g. {If Hotels} | KWD: "Hotels" 

i. [Hotel application] 

h. {If vacations} ] KWD: "Vacations" 
15 i. [Vacation application] 

x. {If My Speaklink {Calendar}} | KWD: "Calendar" 

1 . [Menu Voice Ad: Did you know if you sign up for My 
Speaklink plus you can connect to more calendar 
providers?] 

20 2. [Calendar application] 

xL {If My Speaklink {Buddy lists}} | KWD: "Buddy lists/Buddy 
list/My Buddy list" 

1 . [Menu Voice Ad: Did you know if you sign up for My 
Speaklink plus you can add up to 50 people on your 

25 buddy list?] 

2. Say the buddy name 

i. [Buddy list application] 

xii. {If My Speaklink {Web Bookmarks}} | KWD: "Bookmarks" 

1 . [Menu Voice Ad: Did you know if you sign up for My 
30 Speaklink plus you can add up to 25 web bookmarks?] 

2. Say the name of the bookmark to view 

i. [Bookmark application] 

xiii. {If My Speaklink {File storage}} j KWD: "My files" 

1 . [Menu Voice Ad: Did you know if you sign up for My 
35 Speaklink plus you can add more room to your storage 

box?] 

2. Say help for a listing of files in your box, or say the file 
name 

a. [Message Box Application] 
40 xiv. {If My Speaklink {Dialer/Long distance}} | KWD: "Dialer/Long 

distance" 

1 . [Menu Voice Ad: Did you know if you sign up for My 
Speaklink plus you can have more long distance minutes 
of air time?] 

45 2. Would you like to call a buddy? 

a. {If yes} 
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i. [Buddy list application] 
b. {Ifno} 

i. Say the number you wish you call after the 
tone 

5 1 . [Dialer application] 

xv. {If My Speaklink {Home automation/My home}} j KWD: "My 
home/Home automation" 

1 . [Menu Voice Ad: Did you know if you sign up for My 
Speaklink plus you can add up to 2 home settings?] 
10 2. What home setting would you like to use? 

a. [Homeproxy application] 

b. {If My Speaklink {Quick Jump}} 

i. [Menu Voice Ad: Did you know if you sign up for My Speaklink 
15 plus you can add more functionality to your existing my 

Speaklink settings?] 

1 . Say the quick jump phrase after the tone, 
a. [Quick jump application] 



20 



Global keywords (variables) 



4. During any prompt a subscriber can say the following keywords to get more 
information 
25 a. Help 

i. Disclose the help during any prompt and receive help related to 
that part of the portal you are in. 

b. Exit 

i. Exit the current prompt and go to the main menu 
30 c. Menu 

i. Exit the current prompt and go to the main menu 

d. Goodbye 

i. "Would you like to end your call?" 

1. {If yes} 

35 a. [Hang up application] 

2. {Ifno} 

a. [Return where they left off] 

e. Options 

i. Would you like to change the your menu options? 
40 1. {If yes} 

a. [Options application] 
2. {Ifno} 

a. [Return where they left off] 

f. Language 

45 i. Would you like to change your language settings? 

1. {If yes} 
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a. What language do you prefer to use, English, 
French, German, or Spanish? 
i. [Language application] 

2. {If no} 

a. [Return where they left off] 

g. Tip 

i. Disclose an example for how to use the current prompt 

h. Choices 

i. Disclose the possible choices for the current prompt 



5. Speaklink application design 

a. The following are a list of representative specifications for voice portal 
applications. 

i. VoxSurf/POP email application 
15 1 . {If new messages} 

a. You have [number of new messages]. Here is the 
first message 

i. [READ E-MAIL] 

2. {If no new messages} 

20 a. You have no new messages. Here is the first saved 

old message. 

i. [READ E-MAIL] 

3. {If Options} 

a. Would you like to read new e-mail, read old e- 
25 mail or send new e-mail? 

i. {If send new e-mail} 

a. Say the buddy you want to 
email or say new to send an 
e-mail to a other e-mail 
30 address 

i. [SEND E-MAIL] 

ii. External POP email application 

1 . Which account would you like to check, account 1 or 2? 
a. {Say account and do standard e-mail application} 
35 iii. Voice mail application 

1 . Which account would you like to check account 1 or 2? 
a. {Say account number and dial the number that it 
references} 
iv. Greetings application 
40 1 . Is this greeting dedicated to a special event or are you 

sending an invitation? 
a. {If special event} 

i. Say the greeting category you wish to use 
or say help for the list of occasions to 

45 choose from. 

ii. {Ifhelp} 
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a. Is the occasion for birthday 
wishes, holidays, special 
days, weddings, a thank 
you, romantic greeting, 
5 funny greeting, 

entertainment, business 
greeting or gay & lesbian 
related? 

iii. {If [occasion]} 

10 a. Say the name of the 

greeting you want to send 
or say help to hear your 
choices. 

i. [Display Greeting 

15 application] 

ii. [Buddy list 
application] 

iii. [Messenger 
application] 

20 b. {If invitation} 

i. [Voice site client] 

a. [Display Greeting 
application] 

b. [Buddy list application] 

25 c. [Messenger application] 



The system 10 also enables users to directly contact advertisers through 
the Advertiselt! application 18. As shown in Figure 9, after the user listens to an 
advertisement through a voice portal, the user says a keyword, such as "Speaklink," to 

30 voice click the ad. At this time the user's responses are tracked by the system 10 as the 
user elects to either directly connect to the advertiser's voice site or to the advertiser's 
telephone, or in the alternative, to leave a message on the advertiser's telephone or 
voice site requesting a call back. In this way, instant connects can be made between 
users and advertisers with simple spoken commands. This type of advertising through 

35 welcome ads, keyword ads, and submenu ads as described above, provides high click- 
throughs, brand exposure, market exposure, instant connection, demographic 
marketing, and marketing to targeted subjects. As a convenience to the user, the user 
may "bookmark" the ad or have it stored in their profile for later instant connection. 
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The My.Speaklink application 24 contains a number of features to 
enhance user voice navigation and transactions. For example, a user can have all of 
their messages such as e-mail and voicemail, as well as their faxes, music, and 
document files stored in a universal message box 122. As shown in Figure 11 A, this 
5 message box 122 can then be accessed by the user through the voice portal application 
14 or the web portal application 16. Long-distance messages can be sent via the 
Internet through VoIP to nonsubscribers, as shown in Figure 1 IB. Home automation is 
also possible through microphones placed within a user's home and configured to 
recognize the user's speech. This application can also be used in a user's vehicle. 

10 Through the Web parser application 34 and the bookmarking feature, a 

user can consolidate their personal, work, and other calendars as well as aggregate 
material provided by outside calendar content vendors 132 as shown in Figure 1 ID. 

Figures HE and 11F illustrate the user's ability to customize their 
greetings by speaking a verbal title and sending the greeting to a recipient's voicemail 

15 or telephone number. The user may choose from a music element library 134 to choose 
background sounds, such as a famous star singing Happy Birthday or something 
similar. Though a user can provide a voice attachment to play a personalized message. 
Buddy lists, shown in Figure 11F, allow a user to send greetings and participate in file 
sharing with selected friends via a buddy list connector 136. 

20 As mentioned above, users may bookmark voice sites, as shown in 

Figure 1 1G, to enable quick access to favorite voice sites. 

An important feature of the present invention enables users to quickly 
jump to a particular voice site. This is done by a concatenation of spoken keywords. 
An example of the quick-jump feature would be the sentence: "I want to bid on 

25 computers at e-Bay." The My.Speaklink application 24 is configured to break this 
sentence into phrases or action items such as the first phrase 138 "I want to," followed 
by a second action phrase 140 "bid," followed by an item phrase 142 "computers," and 
concluding with a supplier 142 "e-Bay." The voice browser 146 then takes the user 
directly to the site for bidding on computers. 
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Figure 111 illustrates the feature of extended mail accounts, which 
enables a user to send e-mails to multiple POP e-mail accounts 148. 

Figure 1 1 J illustrates another important feature of the present invention, 
the voice homepage for a user. In this case a consumer calls a subscriber, such as a 
5 business, and the telephone is answered by the host site 56 through the host site voice 
portal 150. The voice portal 150 replaces the traditional voicemail. The consumer can 
then leave a message, enter into a business transaction, or retrieve information from the 
subscriber site. The voice homepage checks to see if the caller is a user of the host site 
voice portal 150 and, if so, they do not have to log in to become part of the same 

10 network. This facilitates faster connections and transactions among subscribers. There 
is no need to change the setup, targeted short ads can be provided, there is instant voice 
commerce, and it is controlled by the consumer as shown in Figure 1 IK. 

The Traffic Speak application 26 is shown in Figure 1 1L where the voice 
portal 14 and web portal 16 cooperate to track the consumer and build demographics 

15 about the consumer, as described throughout above. 

The system of the present invention also provides a method for 
navigating retrieved web-based content. The method includes steps of translating the 
web-based content into a natural language voice content for voice applications; dividing 
the natural language voice content into navigational objects; associating each 

20 navigational object with the pre-built navigation options; and selecting any one of the 
navigation options by voice to perform the navigation option associated with the 
navigational objects. For example, each phrase of a natural language voice content 
would comprise a navigational object. Each object would then be associated with 
certain options available to the user for either reviewing the content of that object or 

25 moving to other objects within the natural language voice content. These could include 
VCR-like capabilities, such as start, pause, fast forward, reverse, fast reverse, stop, 
return to the beginning, and fast forward to the end. The user may also bookmark the 
object for later retrieval. The navigational objects can include applications, such as 
voice-mail, e-mail, facsimile, telephone, and the like. 
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Ideally, the system is configured to return a user to the calling 
application once a called application is completed. For instance, after a navigational 
object is sent to e-mail, the system automatically returns the user to the navigational 
object, and additional applications or navigational objects can be chosen, such as 
5 sending the navigational object or the related voice content, as appropriate, to a 
facsimile or a printer or even to a telephone. 

From the foregoing it will be appreciated that, although specific 
embodiments of the invention have been described herein for purposes of illustration, 
various modifications may be made without deviating from the spirit and scope of the 
10 invention as set forth in the appended claims and the equivalents thereof. 
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CLAIMS 

1 . A method for navigating retrieved web-based content, comprising: 
translating the web-based content into a natural language voice content for 

voice applications; 

dividing the natural language voice content into navigational objects; 
associating each navigational object with pre-built navigation options; and 
selecting any one of the navigation options by voice to perform the navigation 

option associated with the navigational objects. 



2. The method of claim 1, comprising sequentially playing the voice 
content of the navigational object resulting from the selected navigation option and, at the 
choice of the user, playing the voice content associated with the navigational object next in 
sequence or selecting another navigational object. 

3. The method of claim 1, comprising forming navigational objects to 
include at least one application option. 

4. The method of claim 3, wherein at least one application option 
includes at least one from among an e-mail application, a facsimile application, a printing 
application, and a telephone notification application. 

5. The method of claim 4, comprising returning to the navigational object 
from which the navigation option was selected at the conclusion of the selected navigation 
object. 



6. The method of claim 5, comprising bookmarking a navigation object to 
store a link to the navigation object in a memory for later use. 
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7. The method of claim 6, wherein bookmarking comprises speaking a 
voice command. 

8. A method for navigating retrieved web-based content by voice, 

comprising: 

accessing a web server that is configured to: 

translate web-based content into a natural language voice content for 

voice applications; 

divide the natural language voice content into navigational objects; 
associate each navigational object with pre-built voice navigation 

options; and 

accessing a voice browser and selecting a navigation option associated with a 
navigational object; and 

playing the voice content of the navigational object resulting from the 
selection of the associated navigation option. 

9. A voice application server, comprising: 

a navigation engine configured to translate web-based content into a natural 
language voice content for voice applications; divide the natural language voice content into 
navigational objects; associate the navigational object with pre-built navigation options; 
enable selecting any one of the navigation objects by voice to perform the navigation option 
associated with the navigational objects; and provide reusable voice XML-based voice 
applications accessible by a user through the navigational engine. 

10. A method for repurposing textual step-based driving directions into 
voice content for playback, comprising: 

retrieving the textual step-based driving direction content; 
translating the textual step-based driving direction content into natural 
language voice content by translating in the order received each step into natural language 



WO 02/11120 



PCT/US01/24486 



22 

voice content, dividing the voice content into navigational objects, and associating 
navigational options with each navigational object for selection by the user during playback 
of each navigational object. 

11. A method for enabling a caller to transfer to a third party telephone 
number after hearing voice advertisements, comprising: 

providing the voice advertisement; 

providing a key word associated with an action of connecting to an 
advertiser's voice site and providing a key word to bookmark a link to the advertiser's voice 
site; 

carrying out the action associated with the keyword spoken by the user; and 
returning to the advertisement. 

12. A method for jumping to a link inside a voice portal by voice 
command, comprising: 

receiving a voice command containing at least two natural language phrases; 
dividing the at least two natural language phrases into objects that represent an 
action and an item; 

translating the objects into corresponding text objects; 

concatenating the corresponding text objects into a hyperlink to a voice site; 

and 

executing the hyperlink to the identified link in the voice site. 

13. A method for jumping to a link inside a voice portal by voice command, 

comprising: 

receiving a voice command containing at least two natural language phrases; 
dividing the at least two natural language phrases into objects that represent an 
action and an item; 

translating the objects into corresponding text objects; and 
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concatenating the corresponding text objects into a hyperlink to a voice site. 

14. A method for jumping to a link inside a voice portal, comprising: 
receiving a voice command containing at least three natural language phrases; 
dividing the at least three natural language phrases into objects that represent 

an action, an item, and a supplier; 

translating the objects into corresponding text objects; 

concatenating the corresponding text objects into a hyperlink to a voice site; 

and 

executing the hyperlink to the identified link in the voice site. 

15. A method of interacting with a voice home page via a telephone for 
providing voice portal access via subscriber voice-mail number, comprising: 

storing the subscriber's advertising information in a voice content memory; 
receiving a telephone call from a caller; 

providing the caller with options to leave a message or to access a voice-based 

link to a voice website; 

responding to the caller's selection by executing the selected link; and 
capturing the DID number to retrieve subscriber information to provide to the 

recipient of the call. 

16. A system for providing voice portal access via a subscriber voice-mail 
number, comprising: 

a web-based server having a voice browser configured to receive a call and to 
provide a caller with options to leave a message or to access voice-based links to a voice 
website, to respond to a caller's selection by executing the selected link, and provide the 
subscriber information to the recipient of the call. 



WO 02/11120 PCT/US01/24486 



1/29 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 



2/29 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 



4/29 



o 

CD 



o 



o 



<x> 
o 




0-^0^=000 
co o co o to to co 

_Q CD -O CD -O -O _Q 
3 a 3 Q. J 3 3 
CO CO CO 00 CO to CO 



r- cnj ro ^ m to n 



SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 PCT/US01/24486 



7/29 



o 

CD 



O 
v_ 

— 

o 
a. 

a> 
o 



to £ 
.E 9>c^ 

•is , 



> 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



8/29 



PCT/US01/24486 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 



9/29 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



10/29 



PCT/US01/24486 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 



11/29 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 



12/29 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 



1 3/29 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 



14/29 




SUBSTITUTE SHEET (RULE 26) 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 PCT/US01/24486 



16/29 



CD 



O 
CD 



CD 
CO 

o 

"I 








CO 






£= 




CD 


O 




_o 


— 1 


CD 




o 




O 
CO 
_Q 


rvi 


Sto 


ori 


=3 






oo 


Aut 







to 


-o 


CD 


CD 


CD 


_Q 
*i— 


as 


O 






O 


CO 


o 


v_ 


_Q 




I — 


zs 


Z5 




CO 


Q_ 



CD 

"O _Q CD 

oo 



SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 



17/29 



O 



o ^ 
o 



o 

CD 
GO 

CD 
CO 

o 



CO 

o 

Cl. o 



h- (D w ±: 
EZ to o 

% q -3 c: 

o -7" .S2 

O co 1 — i co 

CD CO c c 

Q_ Z3 -<[ O O 

co co u- z o 



o 

CD 



CD 
CO 
O 

o 

v_ 
=3 
Q_ 




CD CO o 

CO CD M 

O =3 -~ 

-£= cr ^ 

O O r 

£ .3 



CD 










CD 


CO 




CD 

_cr 


„E 


EZ 




13 










O 




1 — 


a 

CD 


"0 

a 


CD 


CO 
CD 


ice w 


code. 


Q_ 

CO 


CO 
d 

a 


"co 

CD 


CO 


0 


1^ 


O 


Serv 








"O 




ion 


"co 

CD 
13 

0- 


CD 

_sz: 


>■ 
CD 








0 
. M 








*»— 


CD 
1^ 


*i— 


-O 


CD 


CD 


0 




0 






CO 


-£= 






CD 


*co 


O 


"5 


O 




CO 








"5 


CD 


CJ> 


O 


-O 


0 






V— 




c= 






voii 


Z3 


£= 


CD 


0 




Ql_ 


O 


CO 






ner 




ave 


"is 


CD 
-O 
O 


CD 








CD 


O 






0 








o_ 


CD 
Q_ 


0 


*CO 


CD 






CO 




CD 






_£= 






0 


O 
O 


CD 


ee 


oic 




CD 

o_ 


l_U 






> 




CO 



cot- 
ox o 



<5S 



c: cd c 
W br 
o a o 

1-§S 

h= CD 

o £ ^ 

v_ • — 

Q- CD CD 

_^ > 

c 1 = 
0 * 
o>_2 j_ 
.E a> 



~ CD 
O CD 

j= 

E 

CD O 
> O 

CO 

CD • — 

0 £ 

CD O 
CO O 

a 

CD CO 



CO <Z5 
O CD 

-d .b= o 

O Z3 CO 

CD =5 

O- i- co 



-E CD 
CO _£= 



SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



18/29 



PCT/US01/24486 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 



1 9/29 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 



20/29 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



21/29 



PCT/US01/24486 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



22/29 



PCT/US01/24486 




SUBSTITUTE SHEET (RULE 26) 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 PCT/US01/24486 



24/29 



o 
o 

d 

M 

Q_ 

GO 
CD 
O 



CO 



CD 

o 



<D 



O 
CD 

CO 



o 
E 

o 
o 
co 

to 

E => 

O CD 

m % 

JQ CO 
CD 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 



25/29 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



PCT/US01/24486 



26/29 




SUBSTITUTE SHEET (RULE 26) 




SUBSTITUTE SHEET (RULE 26) 



WO 02/11120 



28/29 



PCT/US01/24486 




SUBSTITUTE SHEET (RULE 26) 




SUBSTITUTE SHEET (RULE 26) 



INTERNATIONAL SEARCH REPORT 


International application No. 




PCT/US01 724486 



A. CLASSIFICATION OF SUBJECT MATTER 
IPC(7) : G10L 13/08; H04M 11/08 
USCL : 704/270.1; 379/88.04 



According to International Patent Classification (IPC) or to both, national classification and IPC 
B. FIELDS SEARCHED 

— ■■— 1 ■ — ■ ■' — -— i ■ ■ 1 ■ 

Minimum documentation searched (classification system followed by classification symbols) 
U.S. : 704/260, 270.1; 379/88.04, 88.25, 88.22 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 
BRS (includes US Patents, EPO Abstract, JPO Abstracts, IBMTBD) 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category * 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


Y 


US 5,726,984 A (KUBLER et al.) 10 March 1998 (10.03.98), columns 45-49. 


10 


Y 


US 5,761,312 A (ZELIKOVITZ et al.) 02 June 1998 (02.06.98), column 4. 


4 


Y 


US 5,794,193 A (GORIN) 11 August 1998 (11.08.98), entire document. 


12, 13, 14 


Y 


GB 2 317 070 A (BUTLER et al.) 11 March 1998 (11.03.98), pages 2-3 and 7-10. 


11 


Y 


US 5,870,549 A (BOBO, II) 09 February 1999 (09.02.99), column 21. 


9 


X 


US 5,915,001 A (UPPALURU) 22 June 1999 (22.06.99), columns 2-12 and 17-32. 


1-3, 5-8 


Y 




4, 9-16 


Y 


US 5,996,006 A (SPEICHER) 30 November 1999 (30.11.99), entire document. 


11, 15, 16 


Y 


US 6,044,403 A (GERSZBERG et al.) 28 March 2000 (28.03.00), columns 7-18. 


10 



^\ Further documents are listed in the continuation of Box C. 1 1 See patent family annex. 



* Special categories of cited documents: 

"A" document defining the general state of the art which is not considered to 
be of particular relevance 

"B* earlier application or patent published on or after the international filing 
date 

"L" document which may throw doubts on priority claim(s) or which is cited 
to establish the publication date of another citation or other special reason 
(as specified) 

"O" document referring to an oral disclosure, use, exhibition or other means 
"P* document published prior to the international filing date but later than the 



later document published after the international filing date or 
priority date and not in conflict with the application but cited to 
understand the principle or theory underlying the invention 

document of particular relevance; the claimed invention cannot be 
considered novel or cannot be considered to involve an inventive 
step when the document is taken alone 

document of particular relevance; the claimed invention cannot be 
considered to involve an inventive step when the document is 
combined with one or more other such documents, such 
combination being obvious to a person skilled in the art 

document member of the same patent family 



Date of the actual completion of the international search 
27 September 2001 (27.09.2001) 


Date oftaailing of the international search report 

*5OCT2001 


Name and mailing address of the ISA/US 

Commissioner of Patents and Trademarks 
Box PCT 

Washington, D.C. 20231 
Facsimile No. (703)305-3230 


Authorized officer 

William R. Korzuch / "/ / f ^> f 
Telephone No. Oafaof&ttyfr^ Jtjff^ 



Form PCT/ISA/210 (second sheet) (July 1998) 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US01/24486 



C. (Continuation) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category * 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


Y 
Y 
X,P 


US 6,078,886 A (DRAGOSH et al.) 20 June 2000 (20.06.00), entire document. 
US 6,081,780 A (LUMELSKY) 27 June 2000 (27.06.00), columns 5, 7, 20-24. 
US 6,240,391 Bl (BALL et al.) 29 May 2001 (29.05.01), entire document. 


12, 13, 14 
10 
1-3, 5-8 



Form PCT/ISA/210 (second sheet) (July 1998) 



INTERNATIONAL SEARCH REPORT 



International appRation No. 
PCT/US01/24486 



Continuation of Item 4 of the first sheet: 

The title lacks precision. (PCT Rule 4.3) The title has been established to read as follows; 



SYSTEM AND METHOD FOR VOICE-ACTIVATED WEB CONTENT NAVIGATION 



Form. PCT/ISA/210 (second sheet) (July 1998) 



